Computer use (beta) (Claude)
https://docs.anthropic.com/en/docs/agents-and-tools/computer-use
#Claude
Claude 3.7 Sonnet and Claude 3.5 Sonnet (new) are capable of interacting with tools that can manipulate a computer desktop environment.
https://github.com/anthropics/anthropic-quickstarts/tree/main/computer-use-demo